ROOK PLACEMENTS IN YOUNG DIAGRAMS AND PERMUTATION 

ENUMERATION 



MATTHIEU JOSUAT- VERGES 



Abstract. Given two operators D and E subject to the relation DE — qED = p, and a word w in M and 
N, the rewriting of w in normal form is combinatorially described by rook placements in a Young diagram. 
We give enumerative results about these rook placements, particularly in the case where p = (l — q)/q 2 . This 
case naturally arises in the context of the PASEP, a random process whose partition function and stationary 
distribution are expressed using two operators D and E subject to the relation DE — qED = D + E (matrix 
Ansatz). Using the link obtained by Corteel and Williams between the PASEP, permutation tableaux and 
permutations, we prove a conjecture of Corteel and Rubey about permutation enumeration. This result gives 
the generating function for permutations of given size with respect to the number of ascents and occurrences 
of the pattern 13-2, this is also the moments of the q-Laguerre orthogonal polynomials. 



1. Introduction 

In the recent work of Postnikov [12j . permutations appear with a new description, as pattern-avoiding 
fillings of Young diagrams. More precisely, he made a correspondence between positive Grassmann cells, 
these pattern-avoiding fillings called J-diagrams, and decorated permutations (which are permutations with 
a weight 2 on each fixed point). In particular, the usual permutations are in bijection with permutation 
tableaux, a subset of J-diagrams. Permutation tableaux have then been studied by Steingrimsson, Williams, 
Burstein, Corteel, Nadeau [U El El [14] , and revealed themselves very useful in the combinatorics of permu- 
tations. 

Corteel and Williams observed, and explained, a rather surprising link between these permutation tableaux 
and the stationary distribution of a classical process of statistical physics, the Partially Asymmetric Self- 
Exclusion Process (PASEP). This model is described in E1[H|- More precisely, the stationary probability of 
a given state in the process is proportional to the sum of weights of permutation tableaux of a given shape. 
The factor behind this proportionality is the partition function, which is the sum of weights of permutation 
tableaux of a given half-perimeter. 

Another way of finding the stationary distribution of the PASEP is the matrix Ansatz of Derrida, Evans, 
Hakim, and Pasquier[5]. Suppose that we have operators D and E, a row vector (W\ and a column vector 
\V) such that 

DE -qED = D + E, (W\E = (W\, D\V) = \V), and (W\\V) = 1. 

Then, coding any state of the process by a word w of length n in D and E, the stationary probability of 
the state w is given by (W\w\V)(W\(D + E^V}- 1 . This denominator (W\(D + E) n \V) is the partition 
function. 

We briefly describe how the matrix Ansatz is related to permutation tableaux [7]. First, notice that there 
are unique polynomials G Z[q] such that 

{D + E) n = nijEWi. 

i,j>0 

This sum is called the normal form of (D + E) n . It is particularly useful, since for example the sum of 
the coefficients riij give an evaluation of (W](D 4- E) n \V). If D and E would commute, the expansion of 
(D + E) n would be described by binomial coefficients. But in this non-commutative context, the process of 
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expanding and rewriting (D + E) n in normal form is combinatorially described by permutation tableaux. 
Then each coefficient n^j is a generating function for permutation tableaux satisfying certain conditions. 
Equivalently this can be done with the alternative tableaux defined by Viennot [21] . 

One of the ideas at the origin of this article is the following. From D and E of the matrix Ansatz, we 
define new operators 

D= q —±D+ 1 - and E=*=±E + l 

q q q q 

Some immediate consequences are 

(1) DE - qED = (W\E=(W\, and D\V) = \V). 

'/ 

This new commutation relation is in a way much more simple than the one satisfied by D and E. It is close 
to the relation between creation and annihilation operators classicaly studied in quantum physics. Moreover, 
from these definitions we have q(yD + E) + (1 — q)(yD + E) = 1 + y for some parameter y. By isolating 
one term of the left-hand side and raising to the n with the binomial rule, we get the following inversion 
formulas between (yD + E) n and (yD + E) n : 

(2) (l- q )^yD + E) n = ^( n \l + yr- k (-l) k q k (yD + E) k , and 

fc=0 ^ ' 

(3) q n (yD + = £ (?) (1 + */)""*(- !)*(! - q)\yD + E) k . 

k=0 ^ ' 

In particular, the first formula means that if we want to compute the coefficients of the normal form of 
(yD + E) n , it is enough to compute the ones of (yD + E) n for all n. Notice that taking the normal form is 
a linear operation. 

Up to a factor —q, these operators D and E are also defined in [19] and [2] . In the first reference, Uchiyama, 
Sasamoto and Wadati use the new relation between D and E to find explicit matrix representations of these 
operators. They derive the eigenvalues and eigenvectors of D + E, and consequently the ones of D + E, 
in terms of orthogonal polynomials. In the second reference, Blythe, Evans, Colaiori and Essler also use 
these eigenvalues and obtain an integral form for (VK|(-D + E) n \V). They also provide an exact integral-free 
formula of this quantity, although quite complicated since it contains three sum signs and several g-binomial 
coefficients. 

In this article, instead of working on representations of D and E and their eigenvalues, we study the 
combinatorics of the rewriting in normal form of (D + E) n , and more generally (yD + E) n for some parameter 
y. In the case of D and E, the objects that appear are the rook placements in Young diagrams, long-known 
since the results of Kaplansky, Riordan, Goldman, Foata and Schutzenberger (see [13] and references therein). 
This method is described in [20] . and is the same as the one leading to permutation tableaux or alternative 
tableaux in the case of D and E. 

Definition 1. Let X be a Young diagram. A rook placement of shape X is a partial filling of the cells of X 
with rooks (denoted by a circle o), such that there is at most one rook per row (resp. per column). 

For convenience, we distinguish with a cross (x) each cell of the Young diagram that is not below (in the 
same column) or to the left (in the same row) of a rook (see Figures T5I6I and [71 further). We will see that 
the number of crosses is an important statistic on rook placements. This statistic was introduced in [9], as 
a generalization of the inversion number for permutations. Indeed, if A is a square of side length n, a rook 
placements R with n rooks may be seen as the graph of a permutation a S 6„, and then the number of 
crosses in R is the inversion number of a. 

Definition 2. The weight of a rook placement R with r rooks and s crosses is w(R) — p r q s . 
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The enumeration of rook placements leads to an evaluation of (W\(yD + E) n 1 \V), hence an evaluation 
of (W\(yD + E) n ~ 1 \V) via the inversion formula ([2]). This is the main result of this article: 

Theorem 1. For any n > 0, we have 

n I n—k \ / k \ 

(W\(yD + = jpl-j-^C-i)* - (A)U+i)) E^^ (fc+1 ^ • 

fe=0 \3=0 J \i=0 / 

The combinatorial interpretation of this polynomial, in terms of permutations, is given in Proposition 1 151 
When y = 1, this can be specialized to: 

Theorem 2. For any n > 0, we have 

wo +*>-iv> - it^b- 1 )' (C 2 ",) - („- 2 ;. 2 )) 

We can see Theorem [5] as a variation of the Touchard-Riordan formula [THj . This classical formula gives 
the g-enumeration of fixed-point-free involutions of size 2n with respect to the number of crossings, and it 
is also the 2nth moment of the q-Hermite polynomials. This formula is: 



(4) v ? cr(/) = — - — yvn , , 

/e!nv(2n,o) k=0 



2n \ I 2n \\ fc(fc+i) 
q 2 : 



where Inv(2n, 0) is the set of fixed-point-free involutions on 2n elements, and where the number of crossings 
cr(Z) is given in Definition 3J 



These two theorems were conjectured by Corteel and Rubey. The earliest conjecture, when y = 1 and 
here stated as Theorem ® was first proved by Rubey and Prellberg [T7] in May 2008. The same method also 
can be used to give an alternative proof of our Theorem [TJ This alternative proof, as well as the material of 
this article, are summarized in the extended abstract 



This alternative proof relies on a decomposition of weighted Motzkin paths, which gives a combinatorial ex- 
planation of the factor Y%=$ V 1 ((") (j+ k ) - Q+fe+i))- But on the other hand > the factor Ei=o yW^ 1 ^ 
is obtained by solving a functional equation and this is a completely non-combinatorial step. It may be pos- 
sible to use the involution principle instead of a functional equation to obtain Xa_ y l q l ^ k+1 ~^ but this is 
still an open problem at the time of writing. 



Besides references earlier mentioned, we have to point out the previous results of Williams [53], where 
Corollary 6.3 gives the coefficients of y m in (W\(yD + E) n \V). It was obtained by a more direct approach, 
via the enumeration of J-diagrams, and was the only known polynomial formula for the distribution of a 
permutation pattern of length greater than 2 (see Proposition [T5")) . Whereas Williams's work is rather focused 
on J-diagrams, our results give more simple formulas in the case of permutation tableaux and permutations. 
Moreover Williams's formulas have also been obtained by Kasraoui, Stanton and Zeng in their work on 
orthogonal polynomials |10j . 



This article is organised as follows. In Section O we describe the link between rook placements and 
the rewriting of (D + E) n in normal form. In Sections [3j [H [5l we obtain enumerative results about rook 
placements, in particular Section |4] contains the bijective step of this enumeration. In Section [6l we use 
these results to prove Theorem [IJ give the combinatorial interpretation of (W\(yD + E) n \V) and some 
applications of the main theorem. In an appendix we give a combinatorial proof of Proposition I12[ which 
gives a generalization of the Touchard-Riordan formula. 
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Notations and conventions 

We denote by Par(n — k, k) the set of Young diagrams with exactly k rows and n — k columns, allowing 
empty rows and columns. The integer n is the half-perimeter of the diagram A € Par(n — k, k), and we can 
see A as an integer partition (Ai, . . . , A&) with n — k > Ai > . . . > Afe > 0. We use the French convention. 
We denote by |A| the number of cells in A, which is also ^i- 

The North-East boundary of A € Par(n — fc, k) is a path of n steps, k of them being vertical and n — k 
horizontal. Reciprocally, for any word w of length n in D and E, with k occurrences of E, we define \{w) S 
Par(n — k, k) by the following rule: we read w from left to right, and draw one step East for each factor D, 
and one step South for each factor E. 

We denote by Inv(n, k) the set of involutions on {1, . . . , n} with k fixed points. 

We use the classical g-analogs of integers, factorials, and binomial coefficients: 



1 



1-5 



and 



k] q V 



Proposition 1. [13) The q-binomial coefficient has the following combinatorial interpretation: 



E 



\ePar(n~k,k) 



and 



q 



fe(fc+l)/2 



E «. 

xePar(n,k) 
x has distinct 
non-zero parts 



Definition 3. For any k, n > 0, the Delannoy numbers are defined by 

n 
k - 1 

Proposition 2. When 2k < n, the number {"} counts the left factors of Dyck paths of n steps ending at 
height n — 2k. In particular, { 2 ™} is the nth Catalan number. They satisfy the relations: 



71 — 1 
k 



n 

n + 1 



= 1, 



and <! '" \ = if k £ {0, // 



!}• 



Proof. The number of left factors of Dyck paths of n steps ending at height n— 2k is easily seen to satisfy the 
same relations as {^}: we just have to distinguish two cases whether the last step is going up or down. □ 
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2. From operator relations to rook placements 



In this section, we make the link between the coefficients of the normal form of (D + E) n , and rook 
placements in Young diagrams. This is done via a combinatorial description of the rewriting in normal form. 
When q = 1, we can view it as a combinatorial statement of a classical result in statistical physics, called 
Wick's theorem. The principle of this method is the same as the one described in the introduction, making 
the link between D and E and permutation tableaux. Moreover the results of these section are presented in 
20J in a slightly different form. 

From now on we assume that D and E are such that DE — qED = p for some parameter p, which is a 
slight generalization of the relation (fl]) . As in the case of D and E, any word w in D and E can be uniquely 
written in normal form: 

w = <•,.,.•:«•?/•.'/>■'• 

i,j>0 

where Cij(w) € Z[p, q]. We have: 

(W\w\V) = 

i,j>0 

The combinatorial interpretation of this polynomial is given by the following proposition: 

Proposition 3. Let w be a word in E and D. Then (W\w\V) is the sum of weights of rook placements of 
shape \(w). 

Proof. Let us denote by T w the sum of weights of rook placements of shape X(w) . We prove with a recurrence 
on \X(w)\, that T w = (W\w\V). 

The base case, |A(w)| = 0, is the situation where the word w is already in normal form: w — E l & for 
some i and j. So we directly have (W|k;|V) = 1 from the properties of (W\ and |V) given in (JTJ) . This 1 
corresponds to the unique rook placement of shape X(w), which contains no rook and no cross since there is 
no cell in this diagram. 

Now we assume that |A(io)| > 0. It is possible to factorize w into w = WiDEw 2 - Indeed, this factor DE 
corresponds to a corner of X(w), and there is at least one corner since |A(w)| > 0. The commutation relation 
of D and E gives: 

w = qw\EDw2 +pwiW2, hence (W|u;|V) = q(W\wiEDw 2 \V) + p(W\wiW2\V). 
So it remains to show that the same relation holds for T w : 

T w = qT wi ££ )W2 +pT WlW2 - 

To this end, we distinguish two kinds of rook placements of shape X(w), whether the corner corresponding 
to the factor DE contains a cross or a rook. It cannot be empty, since being a corner there is no cell above 
it or to its right that may contain a rook. 

The sum of weights of rook placements of the first type is qT Wi edw 2 ' in deed, when removing the corner 
the weight is divided by q and we can get any rook placement of shape X(w\DEw2). 

Similarly, the sum of weights of rook placements of the second type is pT WlW2 . Indeed, when removing 
the corner, its row and its column, the weight is divided by p and we can get any rook placement of shape 

X(W\W2)- □ 

Since (D + E) n expands into the sum of all words of length n in D and E, we also obtain: 

Proposition 4. For any n, {W\{D + E) n \V) is the sum of weights of rook placements of half- perimeter n. 

We can also expand (yD + E) n and get the sum over all words of length n in D and E. But in this case 
each word w has a coefficient y m , where m is the number of occurrences of D in w. Via the correspondence 
between words and Young diagrams, the number of occurrences of D in w is the number of columns in X(w). 
This leads to a refined version of the previous proposition. 
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Proposition5. For any n, (W\(yD+E) n \V) is the generating function for rook placements of half-perimeter 
n, the parameter y counting the number of columns. 



3. Basic results about rook placements 

In this section we introduce the recurrence relation which will be used in the enumeration of rook place- 
ments, and we present two simple examples of enumeration. These two examples involve the g-binomial 
coefficients and the Delannoy numbers defined at the end of the introduction, and they introduce the more 
general formulas we will show later. 

Definition 4. LetTj^^ n {p,q) be the sum of weights of rook placements of half-perimeter n, with k rows, and 
with j rows containing no rook (or equivalently, with k — j rooks). We also define: 

k n 

Tk,nip, q) = ^2 T jA"(P; ?)i and T n{P, 5, y) = X] V^^niPt (?)• 
3=0 k=0 

So Tk t n(p, q) is the sum of weights of rook placements of half-perimeter n with k rows, and T n (p, q, y) is the 
generating function of rook placements of half-perimeter n, the parameter y counting the number of rows. 

Since there is an obvious transposition-symmetry, we can also view the parameter y as counting the 
number of columns. These are polynomials in the variables p, q and y, so we will sometimes omit the 
arguments. From Proposition [5] we know that T n (p, q, y) is equal to (W\(yD + E) n \V). In Figure[T]we give 
some examples of these polynomials. 

T ,l,3 =Pq+P + P, T 1Ai3 = l + q + q 2 , T 2 = l + {l + q+p)y + y 2 . 

EH Q°] [°]_ I Ixl IxTxl I |_ ED 

Figure 1. Some small values of Tj t k >n and T„, together with the rook placements corre- 
sponding to each term. 

Proposition 6. We have the following recurrence relation: 

(5) Tj,k,n = 2j-l,fc-l,n-l + q 3 Tj,k,n-l + p[j + l]qTj+l,k,n-l- 

Proof. We can distinguish three kinds of rook placements enumerated by Tj^, n (see Figure [2]): 

• the first column is of size strictly less than fc, 

• the first column is of size k and contains no rook, 

• or the first column is of size k and contains exactly one rook. 

We show that these three types respectively lead to the three terms of the recurrence relation. 



Figure 2. The three kinds of rook placements we distinguish for proving Proposition [S] 



The first case is the situation where the first step of the North-East boundary is a step down, or equivalently 
the first row is of size 0. Removing this step (or row) is a bijection between these first-type rook placements, 
and the ones enumerated by Tj-i.fc-i,n-i, the first term of ([5|). 
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In the second case, the first column contains exactly j crosses, one per row without rook. So removing the 
first column is a bijection between the second- type rook placements, and the ones enumerated by Tj^^—i, 
and this bijection changes the weight by a factor qK This explains the second term of ([5]). 

In the third case, removing the first column is not a bijection since there are several possibilities for the 
position of the rook in this column. But this map has the property that for any R enumerated by Tj + i_k. n -i, 
the preimage set of R contains j + 1 elements, and their weights are pw(R), pqw(R), . . . , pq 3 w(R). See 
Figure [3] for an example. This shows that the sum of weights of the third-type rook placements is the third 
term of ([5]), and completes the proof. □ 
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Figure 3. We have here four rook placements of the third type, which are equal when we 
remove the first column. Here we have n = 10, k = 6, j = 3, and the sum of their weights 
is (p + pq + pq 2 + pq 3 )p 2 q 3 = p[j + l] q (p 2 q 3 ). This illustrates the third term ofO 



Proposition 7. For any k, n we have: 
(6) T k<k< ., 

i 

Proof. We are counting rook placements without any rook, i.e. such that all cells contain a cross. So this is 
a direct application of Proposition [T] □ 

This proposition is illustrated for example in Figure [T] where we see that = 1 + q + q 2 = [3] q . The 

second example of this section is more subtle and we begin with the following lemma. 

Lemma 1. Given a Young diagram X, the number of rook placements of shape X having no cross and exactly 
one rook per row is either or 1. It is 1 in the case where the North-East boundary is a Dyck path (which 
means that the ith row of X starting from the top contains at least i cells, for any i between 1 and the number 
of rows). 

Proof. Suppose that R is a rook placement with no cross and exactly one rook per row. Then the i first 
rows contain i rooks, which are necessarly in i different columns. So the ith row contain at least i cells, this 
is true for any i, so the North-East boundary is a Dyck path. 

It remains to prove that there is a unique such rook placement in the case where the North-East boundary 
of a Young diagram A is a Dyck path. We show that there is only one way to build this rook placement 
starting from a empty diagram A. First, notice that each corner of the diagram must contain a rook (as we 
saw in previous section, the general statement is that each corner contains either a rook or a cross). Then, 
if we consider the subdiagram of cells that are not in the same row or column of these rooks (see Figure 
|3|), again all corners of this subdiagram must contain a rook by the same argument. We can even say that 
his North-East boundary is also a Dyck path: indeed, the boundary of the subdiagram is obtained from the 
boundary of the diagram by removing each occurrence of a step right followed by a step down. So we can 
conclude by recurrence. 

□ 



Proposition 8. If 2k < n, we have: 

(7) T o ^ n (p,0)=p h 



Proof. We are counting rook placements with no cross (since q = here) and exactly k rooks. Each of these 
rook placements has weight p k , so we just have to prove that there are {^} such rook placements. Knowing 
that {^} is the number of left factors of Dyck paths of n steps ending at height n — 2k, this is a consequence 
of the previous lemma. □ 
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Figure 4. Example of Young diagram whose North-East boundary is a Dyck path, i.e. 
doesn't go below the dotted line. The number of rows is k = 6, the half-perimeter is n = 14, 
and the path ends at height n — 2k = 2. 



4. Rook placements and involutions 



In this section we present the bijective step of the enumeration of rook placements. Indeed, the recurrence 
© is rather complicated to be solved directly. But thanks to this bijective step, we show that there is a 
simple relation between Tj^, n and To t k—j,nt and also that there is a simple recurrence relation satisfied by 

Tq k,n- 



Given a rook placement R of half-perimeter n, we define an involution a(R) by the following construction. 
We label the North-East boundary of R with integers from 1 to n, as shown in the left part of Figure [5] 
This way, each column and each row has a label between 1 and n. If a column, or a row, is labelled with i 
and does not contain a rook, then i is a fixed point of a(R). If there is a rook at the intersection of column 
i and row j, then the involution a{R) sends i to j (and j to i). 
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Figure 5. Example of a rook placement and its image by the map a. 



Given a rook placement R of half-perimeter n, we also define a Young diagram (3{R) by the following 
construction. The North-East boundary of R is a sequence of East steps and South steps, respectively 
denoted by S and E. In this sequence, we overline the letter E if it corresponds to a East step on top of a 
column containing a rook. Similarly, we overline the letter S if it corresponds to a South step on the right of 
a row containing a rook. The non-ovcrlincd letters give a subword of this sequence, and (3{R) is the Young 
diagram corresponding to this sequence. 

For example, with R given in FigureEl the North-East boundary is EEEESSEESSS. With the overlined 
letters we obtain EEEESSEESSS. The non-overlined letters give the word EES. So in this case (3(R) is 
the rectangular Young diagram with 1 row and 2 columns. See Figure [5] for another example. 



X 


X 


X 








o 


X 


X 




X 




X 


X 


X 








o 


X 



0{R) 



Figure 6. Example of a rook placement and its image by the map (3. The grey cells are 
the ones that are in the same row or the same column as a rook. The shape of the rook 
placement is given by the sequence EEESESESS. So (3{R) is defined by the sequence 
EESES. 



Remark: We can see in Figure [5] that the cells of f3(R) are obtained from R by removing all gray cells. This 
is a general fact, and |/3(-R)| is the number of cells in R with no rook in the same row and no rook in the 
same column. 



We also define <fi(R) — (a(R), f3(R)). See Figure[7Jfor another example of a rook placement and its images 
by the maps a and [3. 
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Figure 7. Example of a rook placement and its image by the map 



Proposition 9. The map <f> is a bijection between rook placements in Young diagrams of half-perimeter n, 
and couples (I, A) where I is an involution on {1, ... ,n} and A a Young diagram of half-perimeter \F ix(I) \ . 
If 4>(R) = (I, A), the number of rows (resp. columns) of X is equal to the number of rows (resp. columns) 
without a rook in R. 

This is a classical argument so we don't give a complete proof. This bijection was already defined in 
in terms of partial involutions, i.e. involutions on subsets of {1, . . . , n}. These partial involutions are 
equivalent to the couples (I, A) in the sense that they are involutions with a weight 2 for each fixed point. 

Indeed, a couple (I, A) may be seen as an involution with two kinds of fixed points: those corresponding to 
vertical steps in A and those corresponding to horizontal steps. Similarly, a partial involution / on {1, . . . , n} 
may also be seen as an involution on {1, . . . , n} with two kinds of fixed points: the ones that are not in the 
domain of I, and the ones that are in the domain and fixed by /. 

Now that we have built a bijection, it remains to describe how the weight of a rook placement reads in 
the couple (I, A). We need the following definitions. 

Definition 5. For any involution I , we call 

• an arch of I , a couple (i,j) such that i < j and I(i) = j, 

• a crossing of I, a pair of arches (k,l)) such that i < k < j < I, 

• the height of a fixed point k <EFix(I) the number of arches (i,j) such that i < k < j. 

We denote by cr{I) the number of crossings of I, and by ht(k) the height of the fixed point k. 

For example, let us consider the involution a(R) in Figure [71 There are two crossings, ((1,6), (4,9)) and 
((1, 6), (5, 8)). The fixed points are Fix(J) = {2, 3, 7, 10} and their respective heights are 1, 1, 2 and 0. 

Proposition 10. Let (I, A) = 4>{R). Then: 

• each crossing of I corresponds to a cell of R containing a cross, having a rook to its left ( in the same 
row) and a rook below (in the same column). 

• each triple (i,k,j) such that i < k < j , k €Fix(I) and {i,j) is an arch of I corresponds to a cell of 
R containing a cross, having either a rook to its left (in the same row) or a rook below (in the same 
column). 

Proof. These two statements are respectively illustrated in the left part and the right part of Figure [8] 

• Let ((i, j), (k,l)) be a crossing of /. Since k < j, column k intersects row j in some cell c. Then, (i,j) 
is an arch of /, which means that there is a rook at the intersection of column i and row j, to the left of 
the cell c. Similarly, (k, I) is an arch so there is a rook at the intersection of column k and row I, below 
the cell c. So to this crossing ((i,j), (k, I) we associate the cell c. 
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• Let (i, k,j) be such that i < k < j, k e Fix(7) and is an arch of I. We suppose for example that 
k is the label of a column. Since k < j, row j intersects column k in some cell c. There is no rook below 
the cell c because A: is a fixed point of I. But there is a rook in row k, to the left of c. So to this triple 
(i, k,j) we associate the cell c. 

□ 

i 




Figure 8. Interpretation of crossings, and sum of heights of fixed points, in terms of rook 
placements. 



Proposition 11. If 4>{R) — (I, A) then the number of crosses in R is |A| + fJ-(I), where /j, is the statistic on 
involutions defined by 

n(I)=cr(I) + ht(x). 

xeFix(i) 

Proof. From the definition of the map /?, we directly see that |A| = |/3(-R)| is the number of crosses in R with 
no rook in the same row and no rook in the same column. Besides, from Proposition 1101 we know that the 
number of crossings cr(I) counts the crosses of R with one rook to its left and one rook below. From the 
same proposition, we also know that the sum of heights of fixed points counts all remaining crosses. □ 

The previous proposition means that the number of crosses in rook placements is an additive parameter 
with respect to the decomposition R i— » (I, A). This situation naturally leads to a factorisation of the 
corresponding generating functions, so we get the following corollary: 



To,k- 



Corollary 1. For any j,k,n, we have 

\n-2k + 2j 

(8) Tjk,n — 

Proof. We assume that n — 2k + 2j > 0, since otherwise both sides are 0. Indeed, a rook placement 
enumerated by Tj,k, n contains k — j rooks, so it has at least k — j different rows and k — j different columns, 
so its half-perimeter is at least 2fc — 2j. Using the bijection 4>, we can compute Tj^, n by summing the weights 
of couples (I, A) where I £ Inv(n, n — 2k + 2j) and A € Par(n — 2k + j, j). Hence: 

The first factor of the right-hand side is [™- 2fc + 2 Jl by a direct application of Proposition [TJ The second 

L 3 J q 

factor can be seen as a sum over couples (/, A) where A has rows and n — 2k + 2j columns. So using again 
the bijection <fi, this second factor is To k—j,n- D 

Thanks to this factorisation property of Tj^ n , the problem is reduced to the evaluation of To,fc,n' But 
this factorisation property also gives a recurrence relation satisfied by Tb,fc,«. 

Corollary 2. We have the following recurrence relation: 

(9) Tb,fc,n = Xb, fe ,„_i +p[n+ 1 - 2fc]gT ,fe_i,„_i. 

Proof. When j = 0, the relation ([5]) gives 

Applying the previous corollary to the second term of this sum gives the desired equality. □ 
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5. Enumeration of rook placements 



In this section we solve the recurrence ©, and we obtain an expression for T$^,n involving both q-binomials 
and Delannoy numbers, generalizing the two examples of Section[3J Using the factorisation property olTj t k,n 
and summing over j, we obtain an expression for 



J=0 



i.e. for the sum of weights of rook placements of half-perimeter n with k rows. This expression is rather 
lengthy, with a sum over three indices, but for certain values of p we can simplify it with the g-binomial 
identities of Lemma [5J So in these particular specializations we get expressions for T& in and T n without 
q-binomials. 



Proposition 12. When p = 1 — q, we have 



(10) 



T 0ikin (l-q,q)=J2(-lYq 2 



i=0 



n — 2k + i 
i 



n 

k — i 



Proof. We give here a recursive proof. In the appendix we give an alternative proof, which is much more 
combinatorial. 

Let us denote by f(k,n) the right-hand side of (fTOjl . The initial condition is f(k,0) = To,fc,o = ^ofc so it 
remains to check relation ([9]) when p = 1 — q. Let us define 



A = 



n-l-2k + i 

i 



B = q 1 



i-2k 



n—l-2k + i 
i - 1 



C 



n — 1 

k — i 



D 



n — 1 
k-i-l 



so that we have 



K K 

f(k, n) = ^(-l) l <r^ (A + B)(C + D)= ^(-l)V^ (AC + BC+(A + B)D 



2 = 



After expanding this sum, the second term gives 
k k-l 



n — 2k + i 
i 



n — 1 
k-i-lV 



q 2 q 

i=0 i=0 

(the sum is reindexed such that i becomes i + 1). And the third term gives 

k k 1 

£(-irq^ (a + b)d = ]T(-iyg 

i=0 i=0 

(after noticing that the term where i = k is 0). Adding the previous two identities yields 

k k-l 

^(-l)V^ (BC + AD + BD) = ]T(-ir 9 - 



n — 2k + i 
i 



n- 1 



i=0 



2 = 



n — 2k + i 
i 



-2fe+i+l\ 



But we have [n - 2k + i + l] q [ n_ *. fc+i ] ^ = [ n - 2k + l] q [ 

k 



n-2k+r+ll hcncc 
l J g' 



fc-1 



J2(-iyq-^ (BC + AD + BD) = ]T(-l) 4 g- 



Cj+i) 



j=0 



i=0 



n - 2k + i + 1 

i 



n- 1 

fe-i - 1 



(1 - g"- 2 ^ 1 ) 



Since ^2i =0 (~^-Yq ' * ' AC readily gives f(k, n— 1), we get the relation 

f(k, n) = f(k, n - 1) + (1 - q n - 2k+1 )f(k -l,n- 1), 
which is precisely ^ when p = 1 — q. □ 

Remark: The rook placements enumerated by To k n contain exactly k rooks, so T j^ n (p,q) — p k T ^ ^{l^q). 
This shows that there is no loss of generality in the assumption p = 1 — q of the previous proposition. More- 
over, the Touchard-Riordan formula (0| mentioned in the introduction is a particular case of (fTU)) . Indeed, 
via the bijection of the previous section, involutions without fixed points correspond to rook placements with 
exactly one rook per row and one rook per column (therefore with as many rows as columns). So knowing 
(fTO]) . we directly obtain Q}: 

n 

q ClV) = T , n , 2n (hq) = p^jnT 0>B , an (l - q,q) = (T^E^ 1 ) 1 
7eInv(2n,o) i=0 




Now using ([5]) and (TTUj) . we have the following equality: 



(11) 



Tj,k, n {^ - q, q) 



n-2k + 2j 
3 



£(-dV 



9 i=0 



n - 2k + 2j + i 
i 



n 

k-j 



And as in the previous remark, Tj k n (p, q) = p •'Tj f. n (l,q) so that we have a similar expression for any 
value of p. Summing it over j will give an expression for Tk t n(p, q)- For certain values of p, it is possible to 
simplify greatly this sum. To perform this simplification we need the following lemma: 

Lemma 2. For any k,n>0 we have the following q-binomial identities: 



(12) 



£(-i)V 

3=0 



n-j 




n — k 


n — k 


Q 


. j . 



A; 

(13) £ ' 

3=0 



(fc+l)(n-fc) _ qk(n-k) _|_ _fe(n+l-fe) _ „(fc+l)(n+l-fe) 

Proof. The first two are proved combinatorially using Proposition[TJ We first prove (|13|) , because it is slightly 
more simple. It seems that there is no simple combinatorial proof of (|14p so we prove it with a recurrence, 
which is quite similar to the one of Proposition 1121 

• The left-hand side of (fT3)) counts the pairs (A,/i) G Par(n — k,k — j)xPar(n — k — l,j), for some j 
between and k, signed by (— l) 3 and such that fi has distinct parts. More precisely, A is such that 
n — k > Ai > . . . > \k-j > and fi is such that n — k > /ii > . . . > fij > 0. When k — j > 0, such a 
couple (A, fi) satisfying \k-j < f-j or fj, = (0) can be paired with the couple (A',/i') such that: 

A' = (Ai, . . . , \k- 3 -l), \J = (Ml! ■ ■ ■ if-j^k-j)- 

This couple satisfies |A| + = |A'| + \fi'\ but it has opposite sign. The only couple which is not paired 
with any other is such that Ai = . . . = Afc = n — k and /i = (0), it contributes to the sum with a g fc (™- fe ). 

• The proof of (fT2|) is quite similar. Here the factor gj(j+ 1 )/ 2 means that we count pairs (A, jj) as before 
but such that n — k > /ii > . . . > fij > 0, (because j(j + l)/2 = 1 + . . . + j). Now the pairing is done by 
comparing the smallest non-zero part of A with the smallest part of fi. Depending on the situation, one 
of these parts is moved from A to fi, or from [i to A. The only couple (A, fi) which is not paired with any 
other is such that Ai = . . . = Afe = and /i = (0), and it contributes to the sum with a 1. 
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n-j 




n — k 


n — k 


n 


j 



(u) J2(-iy q ^ 



• When k = 0, both sides of (|14[) are equal to Let us denote by g(n, fc) the left-hand side of (|14[) . We 
define: 

so that #(ra + 1, fc + 1) = ^^(-l)^ -1 ^-:*)/ 2 ^ + B )( C + ^ After expanding this product, we get 
the recurrence relation 

g(n + l,k+l) = q n ~ k g{n, k) + g(n, k + 1) - q n ~ k g(n ~ 1, fc). 

In view of the simple expression of the right-hand side of (|14p. it is straightforward to check that it 
satisfies the same relation. 

□ 



Proposition 13. 

(15) T k>n (l-q,q) = 

mv^)=e{;}( 



fc/' 



3=0 kJ J 



(k-j)(n-k-j) 



'+g" 



(1-9)9" 



Proof. The three identities of this proposition respectively come from (| 1 2[) . ([13)1 and (|T4)l . We prove only 
the last one, because it is the most important case. The two others are proved similarly but more simply. 
Multiplying (QTI by q 2 ^ 2k and summing over j gives 

fe 



2j-2k 



3=0 



E 

0<i,j 
i+j<k 



k-j-i 



J 

2j-2k 



+ 2/ 


k-j 

E(-d^ 


n — 


2fc + 2j + f 






9 i=0 








9 1 - 




n — 


2k + 2f 




2 


'n - 2k + 2j 


+ i 






3 


9 




i 




Q 



Introducing I = k — j — i, we get: 



2j"-2fc 



r fc ,„(y, 9 ) =Ei? rE« 

;=0 k ' j=0 

and after replacing j with fc — Z — j we also have: 



fe-; 



n - 2fc + 2j 
3 



(-1)* 5 '<? 5 



n — fc + j — I 
k-j-l 



2fc ,71 



1-9 



,9 



n 

, i , 

i=o <■ - 1 j=0 

fc 



n 

, I , 

i=o - 1 j=0 

k-l 



k-l 



n-2l- 2j 
k-l-j . 



(-l)'g 



j(j+D 



n-2l-j 
3 



(j-l)(3-2) 



-1-21 



[n-2l-j] q \ 



\j] q \[k-l-j] q \[n-k-l-j] q l 



1=0 



k-l 



=Er;^- i - 2i E(- i )V 

4=0 



-2) 


~n -2l- f 




n — I — k 






n — I — k 




3 




= fc — /, and g 


et (HI]). 


□ 



Remark: By an obvious argument of symmetry by transposition, we have T k ^ n = T n ^k.m and this can be 
directly seen in (IBJ). The summand - q (k-j)(n-k-j) + g (*-i)(A+i-k-j) _ g (fc+i-j)(n+i-fc-j) 

is unchanged when j is replaced with n + 1 — j. Besides, we have {"} = — { n+ "_ J }, so 
i — fc ^ ^ 

I n. 1 / ffc-t-i — i"ir«.— fc— it rfc— iirn.— fc— . rfe— -nrM-n— fe— -n rfc-^i — iVn-t-i — t-^i \ 

= 0. 



j=k+l 



(1-9)9" 
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A consequence is that in (|16[) instead of summing over j between and k, we can sum over j between and 
min(fc, n — k). This is also true for the second identity of (|15|) . In this form, it is clear that T^^ n = T n -k,n- 

The last step of this section is the summing over k to get an expression for T„(-^, q, y). 
Proposition 14. 

(17) (1 - q)q n T n faq, yj = (1 + y)G(n) - G(n + 1), 

Lf J ( n n-2j 



L 2 J f \ ' °~~ J 

where G(n) = E 1 f E y^'" V (b+1_!W - ' 

j=0 ^ J i=0 

Proof. First we define 



p fe = ^>y (fe+1 - i) . 

1=0 

We have to multiply (fT!)]) by y fe , and sum over fc between and n. This gives: 



(1-9)^(^,9,2/)= £ y k \ n ){q (k+1 -^ n - k ^-q 



0<j<k<n 



-k-j) _ n (k-j)(n-k-j) + (fc-j)(r»+l-fe-j) 



n r i / n n n 

^ r y k q (k+i-j)(n-k-j) _ y k q ^-o){n-k-j) + 

A — H W J \ 7._„ 



_g(k+l-3')(l+X-fc-j) 



yk q {k-j)(n+l-k-j) 



j=0 \ k=j k=j k=j 

]y k q 



= X] 1 I ( X] y i+3 ~ 1 q l( - n+1 ~ 23 ~ i) - ^ qi^-^i-i) _|_ ^ y i+j q i(n+l-2 3 -i) 

j=0 ' \ j=l i=0 i=0 

n+l-j \ 
_ yi+j-l q i(n+2-2j-i) j ^ 

i=l / 

after a reindexing of the second and third sums with i = k — j, and of the first and fourth sums with 
i = k + 1 — j. Since (1 — q)q n T n is a polynomial, we can discard all negative powers of q appearing in these 
sums. Modulo non-positive powers of q, these four sums are respectively equal to y°~ 1 P n _2j, y J Pn-i-2j, 
y- 7 P„_2j, y 1 ~ P n +i_2j- But we have to be careful when it comes to the constant terms in q. These constant 
terms are respectively: 

n+l-j 

r 0i \ ^ 2+7 — 1 i(n+l— 2j — i) n—j 

ill V 1 =V X{l<n+l-2j<n-j+l}, 

i=l 

n—j 



[<7°] E y l+ W^- 23 - l) = 1 + 2 / n - i X{0<«-2 J -<„- J -}, 



j=0 

n-j 



[q°] E y l+ W (n+1 - 2 ^ = 1 + 2/ n+1 -^ { o<n + i- 2i <„- 



i=0 



n+l-j 



[q°] E V^- 1 ^- 2 ^ =y n+1 - S X{l<n + 2-2 j <n+l- ih 



14 



where \p is either or 1 whether the property P is false or true. We see that these constant terms in q 
actually cancel two-by-two, so that it remains: 

(i - q)q n T n (^,q,y) = £ \ n \ (V + iT 1 )^ - <M i « - y^Pn+x^) 

n s x n+ 1 

= (i+v)£ >' * - £ ((A) + {"}) «' ;/ ' ' - 

i=o UJ j=0 
= (1 + ?y)G(n) - G(n + 1), where G(n) = ^ | "}^" lp » 



Since the polynomial P n ~2j is zero when n — 2j < 0, we can sum over j between and \ n/2\ in the definition 
of G(n), so that we get ([if]). □ 



6. Application to permutation enumeration 



In the previous section we have computed T„, which is also equal to (W\(yD + E) n \V) thanks to the 
results of Section O Now, using the inversion formula we can compute (W\(yD + E) n \V) and prove 
Theorem [TJ At the beginning of this section we describe the combinatorial interpretation of this polynomial 
in terms of permutations and permutation tableaux. Then we prove Theorem [1] and Theorem [2] and give 
some applications. 

Proposition 15. [4] [6j [7] QUI Q31 [22] For any n> 1 the following polynomials are equal: 
. (WlyiyD + Er^lV), 

• the generating function for permutation tableaux of size n, the number of lines counted by y and the 
number of superfluous 1 's counted by q, 

• the generating function for permutations of size n, the number of ascents plus 1 counted by y and the 
occurrences of the pattern 13-2 counted by q, 

• the generating function for permutations of size n, the number of weak excedances counted by y and the 
number of crossings counted by q, 

• the nth moment of the q-Laguerre polynomials. 

Proof. All this material is present in the references. See also the references for definitions. In particular there 
are several possible definitions for the q-Laguerre polynomials: the one we mention is defined as a rescaled 
version of the Al-Salam-Chihara polynomials as in [10] . We recall that the nth moment of these q-Laguerre 
polynomials is the sum of weights of histoires de Laguerre of n steps. This is also present in [4]. 

Definition 6. An histoire de Laguerre is a weighted Motzkin path such that: 

• the weight of an horizontal step at height h is q % for some i € {0, . . . , h— 1} or yq l for some i G {0, . . . , h}, 

• the weight of a North-East step starting at height h is q l for some i € {0, . . . , h}, 

• the weight of a South-East step starting at height h is yq % for some i € {0, . . . ,h— 1}. 

The classical bijections between permutations and histoires de Laguerre, namely the Frangon-Viennot and 
Foata-Zeilberger bijections, give the equality of the last three items in the list of Proposition PT5l 

As said in the introduction, the link between the operators D and E of the matrix Ansatz and the 
permutation tableaux was first exposed by Corteel and Williams in [7] . This shows the equality of the first 
two items in the list. See also [22] , 

To end this proof we can use the bijection between permutation tableaux and permutations exposed in 
[B]: the number of columns in permutation tableaux corresponds to the number of ascents in permutations, 
and the number of superfluous l's corresponds to the number of occurrences of the pattern 13-2. We also 
have to mention the previous results of Postnikov, who made the link between J-diagrams, which generalize 
the permutation tableaux, and alignments in decorated permutations |12 | 123 ] . □ 
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We now give the formula for the polynomials of Proposition [T3J This is the Theorem [T] stated in the 
introduction. 

Theorem 1. For any n > 1, we have 

n I n—k \ / k \ 

(w\( yD + Er-^v) = w L^Y,(~ 1 ) k E^'((")(A) - (A)U + i)) E^ ,(w " !) • 

fc=0 \j=0 / \i=0 / 

Proof. Using the main result of the previous section (|17p and the inversion formula ((2|), we obtain: 

n-l 

(W|(l - g)»(yl> + EY-^V) = (1 - <?) £ (VX 1 + J/)""^^^!^ + £) fe |F) 

7i — l n 

= E (V) C 1 + i/) w-1 ~*(-i)*((i + y) G ( k ) G ( k + !)) = E (!•) C 1 + y)"- fe M) fc G(fc) 

fe=0 fe=0 

= E CDa+^Vi)H4^ (fe ~ i)/2 ~ lp * = ^B- 1 ) 4 ( E J ( 2fc n + J(i+^r- 2fc - 4 {T> fc ) p<, 
o<i<k<n y t=o y /t=o y 

z=fc mod 2 

after a reindexing such that k becomes 2k + i. It remains to simplify the sum between parentheses. After 
expanding the power of 1 + y, this sum is: 



E 



E 2 J n 2k^ i , ^ \ (n—2k — i\ (2k + i 
^ \2k + i)\ j )\ k 

k=0 j=Q v 7 v J / K 

n\ ( 1 1 



j\(n-2k-i- j)\ \kl(k + i)\ (k - l)l(k + i + 1)! 

- E 



(to - fc)!(n - m - fc - i)! + i)\ (k - l)!(fc + i + 1)! 

n — z / / \ m / \ m \ 

E m I I n \ \ fm - ! /n-mN _ / 71 \ \ ^ /m-l\ /n-m+lA I 
» L Zjiwu+ii i TO _ 2 ) U-iA k+i+i ) I ■ 

But thanks to the Vandermonde identity, the two sums over k may be simplified: 

m , s ro , s 

E/m\ M-m\ / n \ /m — 1\ /n-m+l\ / n \ 

\k)\ k+i ) ~ \ m + iJ , 2-~t Vfc-lJ V k+i+1 ) ~ Vto + J + I/ ' 

fc=0 V 7 k=0 V 7 

and this completes the proof. □ 

Remark: The number (™) — (j-i) (j+fc+i) ma y ' 3e seen as the determinant of a 2 x 2-matrix of binomial 
coefficients. The Lindstom-Gessel-Viennot lemma gives a combinatorial interpretation of this quantity in 
terms of lattice paths: it is the number of pairs of non-intersecting paths with starting points (1,0) and 
(0, 1), with end points (J, n — j + 1) and (J + k + 1, n — k — j), and only with unit steps going North or East, 
as in Figure [9l In particular when k = 0, this is the Narayana number N(n + 1, j + 1). 

Proposition 16. The coefficient of y rn in (W\(yD + E) n ~ 1 \V) is given by: 

n m 

[y m ](W\(yD + E)^\V) = -— - £ £ (_i)V™-i)(W-J+i-») ((«) (."J - (."J 

Proof. We just have to expand the products in the equality of Theorem Q] since each of the factors between 
parentheses is a polynomial in y and their coefficients are explicit. □ 
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n -j + 1 



n — k — j — i — 

' tjHHE 

1 j j+k+l 

Figure 9. Interpretation of a determinant of binomials in terms of lattice paths. In this 
example, we have n = 8, j — 3, k = 2. 



In [23], Williams provides a different formula for the same polynomial, indeed [y k ](W\(yD + E) n 1 \V) is 
also equal to: 

fc-i 

n\ I n 



i=0 \ \ / \ 

She shows that this polynomial is a g-analog of Eulerian numbers that interpolates between Narayana number 
(when q = 0), binomial coefhcents (when q = —1), and of course Eulerian numbers (when q = 1). 

We can also obtain these results from the expression of Proposition 1161 For example, if we put q = in 
the previous equality, it tells that the number of permutations avoiding the pattern 13-2 and with m ascents 
is: 

2 n n+1 



E(- 1 ) fe (C)UJ-L"i)UVi)) = □ +E(- 1 ) fc C)UJ + E(- 1 ) fc L- 1 ) 

fc=0 ^ ' fe=l fe=l 

" ^-"'("mOUO-O'-Cm 1 )^- 1 ^©- 



This alternating sum of binomials is also the binomial ("j" 1 )- So the number we get is (^) 2 — C^ 1 ) ("m 1 )- 
Although it is not the most common way to define it, this number is the Narayana number N(n, m), as can 
be combinatorially seen using again the Lindstrom-Gessel-Viennot lemma. 

We now give the specialization when y = 1. This is the Theorem [2] stated in the introduction. 

Theorem 2. For any n > 1, we have 

as, W( z> +£r -^>= ^ d-d' ((;:,) -(„_t_ 2 )) (£■ 



(\-q) _ v . _ 



k 

Mk+l-i) 



Proof. We just have to substitute y = 1 into the equality of Theorem [TJ We can simplify the resulting 
expression using again the Vandermonde identity, indeed we have 



k n—k / 

2n 
n — k 



(j)(j+fe) — E (j)(n-fc- 

-k n—k 



E (j-i) (j+fc+x) = E 0-x) (n-j-fe-i) = ( n _ i. _ 2 ) ' 
and the result follows. □ 



Among the several objects of the list in Proposition [151 the most studied are probably permutations and 
the pattern 13-2, see for example [31 [T31 [T5] . In particular in [31 [H] we can find methods for obtaining, as 
a function of n for a given k, the number of permutations of size n with exactly k occurrences of the pattern 
13-2. By taking the Taylor series of ([2]), we obtain direct and quick proofs for these previous results. As an 
illustration we give the formulas for k < 3 in the following proposition. 
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Proposition 17. The order 3 Taylor series of (W\(D + E) n l \V) is 

w + -)-'iv> - c + („ 2 : 3 > + K,, 2 "^ + ™^(„ 2 : 5 y + °<« 4 >. 

where C n is the nth Catalan number. 

Proof. On one side, we have (1 - q)~ n = 1 + nq + ("J 1 )? 2 + C']" 2 )? 3 + 0(g 4 ). On the other side, we have 
Ei=o = 1 + g^ife + 2q 2 6 2 k + 2q 3 S 3k + 0{q A ). The constant term is: 

£ (G - *) " (n -t- 2)) = (T) ~ (n 2 - l) = C - 

So this Taylor series is 



(1 + m + r+ v + civ) (c n (ej - ey) g + (e 2 ) - ej) ? 2 - (eg - ey) <? 3 ) . 

After expanding the product, all coefficients can be seen as the product of ( 2 ^ 1 ) and a rational fraction of n. 
So the simplification is just a matter of simplifying rational fractions of n, which is straightforward. □ 



More generally, a computer algebra system can provide higher order terms, for example it takes no more 
than a few seconds to obtain the following closed formula for [q 10 ](VF|(Z? + E) n ~ l \V): 

io!(n+i2)!(n-8)! + 70 n " + 2093 n " + 32354 ^ + 228543 n 9 - 318990 n 8 - 17493961 n 7 - 104051458 n 6 

-6828164 n 5 + 2022876520 n 4 + 6310831968 n 3 + 5832578304 n 2 + 14397419520 n + 5748019200^ , 

which is quite an improvement when compared to the methods of [15 . Besides these exact formulas, the 
following proposition gives the asymptotic for permutations with a given fixed number of occurrences of the 
pattern 13-2. 



Theorem 3. for any m > we have the following asymptotic when n goes to infinity: 



[q m ]{W\{D + E) n -^\V) 



Proof. When n goes to infinity, the numbers ( n 2 ™ fe ) — („_ 2 fc_ 2 ) are dominated by the Catalan number ( 2 ^) . 
It implies that in (1 — q) n (W\(D + E) 11 ^^) , each higher order term grows at most as fast as the constant 
term C n . On the other side, the coefficient of q m in (1 — q)~ n is equivalent to n m /m\. So we have the 
asymptotic 

C n m 

{q^iWKD + E)"- 1 ^)-^-. 
Knowing the asymptotic of the Catalan numbers, we can conclude the proof. □ 

Since any occurrence of the pattern 13-2 in a permutation is also an occurrence of the pattern 1-3-2, a 
permutation with k occurrences of the pattern 1-3-2 has at most k occurrences of the pattern 13-2. So we 
get the following corollary. 

Corollary 3. Let ipk{n) be the number of permutations in & n with at most k occurrences of the pattern 
1-3-2. For any constant C > 1 and k > 0, we have 



Mn) < C 



4 n n fe ~t 



when n is sufficiently large. 
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Proof. By the previous remark we have 

k 

i=0 

so this is a consequence of Theorem [3J which gives the asymptotics of each of these terms. □ 

So far we have mainly used Theorem O Now we illustrate what we can do with the refined formula given 
in Theorem [1] We already mentioned that we get Narayana numbers when q = 0, but we can also get 
the coefficients of higher degree in q. For example it is conjectured in [53] that the coefficient of qy m in 
(W\y(yD + is equal to ( m ™ J ( m ™ 2 ). With our results we can prove: 

Proposition 18. The coefficients of qy m and q 2 y m in (W\y(yD + E) 7 ^ 1 \V) are respectively 



n \ f n 



and 



(nA 




/ n-\ 




\m - 




\m - 





m + lj\m-2j \m-2j\m + 2J 2(n + 1) 

Proof. A naive expansion of the Taylor series in q gives a lengthy formula, which is simplified straightfor- 
wardly after noticing it is the product of ( n J and a rational fraction of n and m. □ 



Appendix 

We give here a combinatorial proof of Proposition [151 As noticed earlier, this result is a generalization of 
the Touchard-Riordan formula (|U), and this combinatorial proof is a generalization of Pcnaud's combinatorial 
proof 16J of ([4]). We follow very closely this reference, even in some notations. Moreover the ideas of this 
proof were inspired by the alternative proof of Theorem [T] mentioned in the introduction (see [5]). 

Proposition 19. There is a bijection between involutions on {1, ...,n} and weighted Motzkin paths of n 
steps with the following properties: 

• The weight of an East step at height h is q h . 

• The weight of a Sout-East step starting at height h is q l for some i € {0, . ..,h — 1}. 

Moreover the image of an involution I on {I, ... ,n} is a weighted Motzkin path with total weight q^\ 

Proof. This is obtained via the same methods as the bijection between involution without fixed points and 
Hermite histories, see [16] . It is also very similar to the Foata-Zeilberger bijection. See Figure [Till for an 
example. □ 



Figure 10. An involution and the corresponding weighted Motzkin path. 




To compute Tq^ n (l, <?), we have to sum the weights of the weighted Motzkin paths having n steps, and 
n — 2k East steps. When we multiply by (1 — q) k , there are many cancellations in this sum. Indeed we 
easily see that to compute Tq^^O- — q,q), we have to sum the weights of Motzkin paths of n steps satisfying 
conditions (C2): 

• the weight of an East step at height h is q h . 

• the weight of a Sout-East step starting at height h is either 1 or —q h . 
Now, we give a decomposition of these weighted Motzkin paths. 

Proposition 20. There is a weight-preserving bijection between weighted Motzkin paths satisfying (C2) and 
couples (Hi, H 2 ) such that for some i € {0, . . . , k}, 

• H\ is a left factor of a Dyck path, with n steps and ending at height n — 2k + 2i, 
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• i?2 is a weighted Motzkin path of n — 2k + 2i steps, with n — 2k East steps, statifying conditions (C2) 
above, and also that any South-East step following a North-East step has weight ~q h (i.e. not 1). 

Proof. This is similar to Lemma 1 in [5]. □ 

A weighted Motzkin path as H2 above is called a core. The enumeration of left factors of Dyck path is 
given by Delannoy numbers. On the other hand, to compute the sum of weights of cores we need two other 
lemmas. 

Lemma 3. There is an involution 7.; on cores of length n — 2k + 2i with n—2k East steps, with the following 
properties: 

• if a core and its image are different they have opposite weights, 

• the fixed points of 7$ are the cores such that: 

• the i first steps are North-East, and all following steps are East or South-East, 

• a South-East step starting at height h has weight —q h (i.e. not 1). 

Proof. In this proof we use a word notation for cores: the letters x, z, y, and y respectively correspond to 
North-East steps, East steps, South-East steps weighted by 1, and South-East steps weighted by — q h . For 
a core c, let u(c) be the length the last sequence of consecutive x's. Let v{c) be the height of the last y if 
there is no x after this y, and i otherwise. The fixed points of 74 are the cores such that u(c) = v(c) = i. 

From now on we assume that c does not satisfy u(c) = v{c) — i. The involution ji is such that w(c) > v(c) 
if and only if u("fi(c)) < v(ji(c)). Suppose that u{c) > v{c). Let c be the word obtained from c when we 
replace the last y with a y. There is a unique factorization c = fix u ^ay^f2 such that: 

• a is either z or y, 

• /2 begins with a y and contains no x. 
We set 

7i(c) = /iZ u(c) -* (c V^ (c) /2. 

See Figure [TT] for an example. 



Figure 11. A core c and its image by 74. The thick lines indicate the y, i.e. the South-East 
steps weighted by — q h . In this example we have n — 2k = 3, i — 9, u = 4, v = 2. We can 
check that w(c) = —q 17 = — w(7i(c)). 



Simple arguments of word combinatorics show that: 

• c and its image have opposite weights, 

• any core c' such that u(c!) < v(c') is obtained as a 7j(c) for some c satisfying u(c) > v(c). Indeed, 
let c' be the word obtained from c' by replacing the last y at height u(c') with a y. There is unique 
factorization c' = f\ay^x u ^ c '/2, where a is z or y and contains no x. Then c = f\x u ( c ^ayi /2 has the 
required properties. 

These arguments, put together, show that 7^ has the claimed properties. □ 
Lemma 4. The sum of weights of the fixed points of 7^ is 



E 



w(H 2 ) = (-l)V 



2k + i 

i 



Proof. A fixed point of 7$ is fully characterized by the heights hi 
these heights can take any values such that i > h\ 



-2k 



of the n — 2k East steps, and 



> ••• > h n —2k ^ 0- Such a fixed point of ji has weight 
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indeed the South-East steps have weights — q 1 , . . . , — q 2 , —q and they correspond to the factor (— l) l q ( % ' . 
It remains to sum over hi and we can conclude thanks to Proposition Q] 

Now we can prove: 

Proposition 12. 



' -2k + i 



ro, fc ,„(l-?,g) = ^(-l) i ^ 

i=0 



n 

k — i 



Proof. The decomposition of weighted Motzkin paths stated in Proposition [20] gives 

k 



To, k , n (l-q,q)=J2\ U _ \"£w(H 2 ), 

i— n ^ J tr„ 



i=0 ff 2 

where the second sum is over cores H 2 of n — 2k + 2i steps with n — 2k East steps. Thanks to Lemma [31 we 
can restrict the second sum to the fixed points of the involution 7^. And thanks to Lemma [H this sum is 

E fTT , , 1Ni r«- 2fc + z" 
w (H 2 ) = (-iy q ^ 

ff 2 L J 9 

This completes the proof. □ 
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